Entropic sampling dynamics of the globally-coupled 
kinetic Ising model 



Beom Jun Kim 1 and M Y Choi 2 ' 3 

1 Department of Molecular Science and Technology, Ajou University, Suwon 442-749, 
Korea 

2 Korea Institute for Advanced Study, Seoul 130-722, Korea 

3 Department of Physics, Seoul National University, Seoul 151-747, Korea 

E-mail: beomjun@ajou.ac.kr 
Abstract. 

The entropic sampling dynamics based on the reversible information transfer to and 
from the environment is applied to the globally coupled Ising model in the presence 
of an oscillating magnetic field. When the driving frequency is low enough, coherence 
between the magnetization and the external magnetic field is observed; such behavior 
tends to weaken with the system size. The time-scale matching between the intrinsic 
time scale, defined in the absence of the external magnetic field, and the extrinsic time 
scale, given by the inverse of the driving frequency, is used to explain the observed 
coherence behavior. 
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1. Introduction 



The stochastic resonance |Tj, which has been extensively studied in various systems 
including many-body systems [21 HD IU El El El HE ITUl ITTj . refers to the phenomenon that 
an appropriate amount of stochastic noise may not hinder but trigger the coherence 
between the output signal and the weak periodic input signal. In Ref. pTTj , a detailed 
study of the two-dimensional kinetic Ising model has been made and the size- dependence 
of the dynamic phase diagram has been identified. The globally-coupled kinetic Ising 
model in the presence of a time-periodic external magnetic field has been investigated 
much, mainly because the simple mean-field method can be applied jUEIj. In particular, 
the model has been recently shown to possess double stochastic resonance peaks at two 
distinct temperatures p. However, except for some systems [7], general applicability of 
the Glauber dynamics is hardly justified in many real systems. 

The importance of the role of the entropy has been pointed out in the biological 
evolution [12]: In general, every species attempts to minimize its entropy, or in other 
words, to get negative entropy from the environment. From this idea, it has been shown 
that the biological evolution of an ecosystem can be well described by the so-called 
entropic sampling dynamics fH]- We believe that the Ising model studied in this work 
can be related to a wide range of phenomena in biological and social systems, like 
the opinion formation problem in social systems under the time-periodic influence [Oj. 
Very recently, it has been suggested that the ubiquitously observed self-organized critical 
behavior in nature is caused by the reversible information transfer with the surroundings 
of the system J3]. This implies that the entropic sampling dynamics, which is based 
on the reversible information exchange with the environment, can have realizations in 
many systems. 



2. Entropic Sampling Dynamics of Globally Coupled Ising Model 

We in this work use the globally coupled Ising model, the Hamiltonian of which is given 
by 

i^j i 

where o~i = ±1 is the Ising spin at site i, J is the coupling strength, N is the 
total number of spins, and the external magnetic field h is coupled to the total 
magnetization M = Yli a i- We first compute the entropy S by using the entropic 
sampling algorithm applied to the Hamiltonian in Eq. at constant magnetic 

field h. The detailed balance condition for the entropic sampling reads [T3] 

ll ?} - p -{S[E(a')]-S[E(a)]} / o\ 

where W(a — > a') is the transition probability from a = {a\, era, • • • , Cjv} to a' = 
{a[, o~' 2 , ■ ■ ■ , o~' N }, and for convenience, only a single spin is allowed to change at a given 
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Figure 1. Entropy S(E;h) as a function of the energy e = E/N per spin and the 
external magnetic field h. Each curve at a given value of h was obtained from the 
entropic sampling algorithm applied to the Hamiltonian in Eq. Q). 



time. In the entropic sampling algorithm, one initially starts from S(E) = for all values 
of the energy E, and obtains the histogram H(E) for several Monte Carlo sweeps, which 
is then used to estimate a new value of S(E): 

j S(E) for H(E) = 0, 

1 ' \ S(E) + In H(E) otherwise. { ) 

As the above procedure proceeds, S(E) approaches the true entropy up to an additive 
constant, which is independent of the energy E and thus may be subtracted on the 
condition that the minimum of S(E) is zero. 

Once the correct entropy is obtained, the time evolution under the entropic 
sampling should satisfy the detailed balance condition in Eq. (J2J) and we choose the 
following procedure: (1) Generate a' which differs from a only at one spin, e.g., 
a' = {o"i, <7 2 , • • • , — o~j, ■ • ■ , <7jv} obtained from a = {a\, 02, • • *, (Tj, • ■ ■ , ctn}. (2) Compute 
the entropy change AS = S[E(a')] — S[E(a)]. (3) If AS < 0, accept the try, i.e., change 
a to a'; otherwise, accept the try with the probability e~ As . One sweep of the above 
procedure for all the spins in the system corresponds to one time unit in the present 
work. 

Figure^shows the entropy S(E; h), computed for the system of size iV = 1600 under 
time-independent field h, as a function of the energy per spin, e = E/N (henceforth, we 
measure the energy in units of the coupling strength J) obtained from 10 8 sweeps per 
spin. In the ground state all spins have the same value: o~i = 1 if h > 0, and o~i — — 1 
otherwise. Accordingly, the ground state energy is given by -E gr0 und = —N/2 — hN or 
e g round = E gTOUn d/N = — 1/2 — h. It is observed in Fig. d that S(E; h) = for e < e groU nd- 
One can also compute S(E; h) analytically as follows: From Stirling's series expansion, 
it is straightforward to get the entropy S(m = M/N) as a function of the magnetization, 



S(m) w -N 



1 — m I — m 1+m 1 + m 
In 1 In 



Entropic sampling dynamics of the globally- coupled kinetic Ising model 



4 



The entropy S(E; h) is then obtained from Eq. ([TJ with E/N = —m 2 /2 — hm. Since E is 
a quadratic function of m, S(E; h) obtained in this way has two branches. In numerical 
simulations, we always observe only the upper branch, since it has tremendously more 
number of states than the lower branch. We confirmed that the numerically obtained 
S(E; h) is in a good agreement with the upper branch of the analytic one. However, 
since Stirling's formula fails at m = ±1, we instead use the numerically obtained S(E; h) 
for the time evolution of the system. 

The entropy S is not a dynamic quantity but a thermodynamic quantity. In the 
present work, we consider the case that the external magnetic field h(t) = h sm(Qt) 
varies with time so slowly. In this low- frequency limit (i.e., the driving frequency Q is 
sufficiently low), we may use the adiabatic approximation: At a given instant of time 
t, the entropy S(E; h) computed above at constant external field h is used for the time 
evolution of the system under the time- dependent field h(t). In practice, S(E;h) is 
computed at 100 different values of h in the range < h < h with h set equal to 0.1 
throughout the work, and for a given value of h(t), we choose S(E; h) with the value 
of h closest to that of h(t). From the symmetry of Hamiltonian in Eq. one has 
S(E; —h) = S(E; h), which is utilized for the time evolution during the period h(t) < 0. 

3. Results 

The time evolution of the magnetization m(t) = M(t)/N = (1/N) ^ o~i(t) is displayed 
in Fig. |2]for the system of size N = 1600 at driving frequencies Q = (a) 0.005, (b) 0.02, 
and (c) 0.05. Observed is the coherence behavior at lower frequencies between m(t) and 
h(t), which may be explained in the following way: When h(t) > 0, the energy of the 
system is low for a larger value of m(t). Since the entropy is a monotonically increasing 
function of the energy and since the entropic sampling dynamics tends to decrease the 
entropy, the positive value of h(t) drives the system to have a larger value of m(t), 
resulting in the coherence behavior observed in Fig. [21 At small driving frequencies, 
the system has enough time to adjust itself to follow the external driving, and thus 
exhibits coherence behavior between the magnetization and the external driving well. 
On the other hand, as the driving frequency becomes higher, i.e., as the external driving 
changes in time too fast, the spins in the system do not have time enough to follow the 
driving h(t). 

Such coherence behavior in Fig. |2j which we call entropic coherence to emphasize 
the role of the entropy, can be quantitatively detected by the occupancy ratio R, defined 
to be the average fraction of the spins in the direction of h(t) |B1 116j: 



with (■ ■ -) t denoting the time average. For the time sequence like the one in Fig. |2Jc), 
the occupancy ratio R has a value close to 1/2 since very few spins follow the driving 
h(t) during the time period h(t) < 0. The occupancy ratio as a function of the driving 
frequency is displayed in Fig. |H] for the system of size iV = 1600. As expected from 
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Figure 2. Entropic sampling time evolution of the magnetization m(t) in a system 
of size N = 1600 at driving frequency fl = (a) 0.005, (b) 0.02, and (c) 0.05. Time 
series data have been obtained from the initial condition that all spins are aligned to 
have m(t = 0) = 1. For comparison, the time evolution of the external magnetic field 
h(t) = hosm(Qt) with ho = 0.1 is also displayed (see the dashed lines). At sufficiently 
small values of fi, m(t) is observed to follow the external field h(t) well. As f2 is raised, 
such coherence behavior is shown to become weaker. 
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Figure 3. Occupancy ratio R as a function of the driving frequency fl for the globally 
coupled Ising model of size N = 1600. As f2 becomes higher, coherence is observed to 
diminish: R(u) — > 0.5 as fi is increased. 
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Figure 4. Entropic sampling time evolution for the globally coupled Ising model at 
driving frequency n = 0.01 for size N = (a) 400, (b) 1600, and (c) 2400. As N is 
increased, the coherence behavior becomes weaker. 

Fig. El the occupancy ratio is observed to decrease with Q and approaches the value 
1/2, signaling the disappearance of the coherence behavior at higher frequencies. 

From the above observation, it is expected that the competition of time scales 
should play an important role in the coherence behavior. We use the reasoning similar 
to that in the standard stochastic resonance |B] and identify the two times scales as 
follows: One is extrinsic and originates from the external driving frequency, and the 
other is intrinsic, in principle not depending upon the external driving. The extrinsic 
time scale r ext = reduces as the driving frequency Q is increased, while the intrinsic 
time scale r is fixed and independent of Q. When r ext ^> r, the system has enough time 
to relax and to follow h(t), while in the opposite limit r cxt <C r, spins cannot follow h(t) 
which varies too fast. The intrinsic time scale r, computed from the correlation function 
(m(t)m(O)) in equilibrium with the ensemble average (• • •), has been shown to follow 
the simple power law r ~ N 14J. Qualitatively, one can also interpret r as the time 
scale required to overcome the entropic barrier separating m — 1 and m = — 1. 

Figure 0] shows the time evolution of the magnetization m(t) in the presence of 
external periodic driving h(t) = ho sin(Oi) with Q = 0.01 for the system size iV = 
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Figure 5. Occupancy ratio R versus the system size N at driving frequency = 0.01 
and 0.02. As N is increased, entropic coherence becomes weaker and gradually 
disappears in sufficiently large systems. 

(a) 400, (b) 1600, and (c) 2400. As the size N is increased, the internal time scale r 
grows, and eventually when r becomes too large compared with r ext , the spins in the 
system cannot follow the external field. The behavior of the occupancy ratio R with 
the size N is shown in Fig. El at external frequencies Q = 0.01 and 0.02, which manifests 
the disappearance of the coherence behavior as the system becomes larger ^H]- Such 
a behavior may have interesting implications in sociological systems: Social collective 
behavior in accord with external driving may disappear quickly as the group size exceeds 
the critical value. In other words, the control by means of an external agent (e.g., laws or 
other social regulations) may become completely inefficient if the society grows too large. 
When this happens, enhancing interactions among people rather than strengthening 
social enforcement can be more effective for collective behavior to emerge. 

4. Conclusion 

In summary, we have studied the coherence behavior in the globally coupled Ising system 
under a time-periodic external magnetic field. The entropic sampling algorithm has been 
used both for the calculation of the entropy and for the time evolution of the system. 
When the external driving frequency is sufficiently low (namely, when the external 
field varies slowly with time) and when the system is not too large, the coherence 
behavior between the magnetization and the external field has been observed. It seems 
appropriate to call this phenomenon entropic coherence, which emphasizes the role of 
the entropy in the time evolution. It is noteworthy that if one uses the similar entropic 
sampling time evolution for the entropy as a function of, e.g., the magnetization S(M) 
instead of the energy, we do not have the coherence behavior: S(M) can be computed 
from a purely combinatorial counting problem and accordingly, does not reflect the 
presence of the external magnetic field in the Hamiltonian (0). It is plausible that this 
entropic coherence idea may be used to explain the coherence behavior of those systems 
the dynamics of which are more appropriately described by the entropy. The importance 
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of the entropy has been pointed out in the description of the biological evolution ^2] 
and the resulting dynamics has been suggested to be of wide applicability to a variety 
of the self-organized critical systems ^1] . Accordingly, we believe that the present work 
can be extended to explain, e.g., various social and biological systems in the presence 
of periodic external driving coupled to the internal degrees of freedom. 
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